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I , The error autocorrection effect means that in a calculation all the 

' intermediate errors compensate each other, so the final result is much 

' more accurate than the intermediate results. In this case standard 

, interval estimates (in the framework of interval analysis including the 

so-called a posteriori interval analysis of Yu. Matijasevich) are too 
pessimistic. We shall discuss a very strong form of the effect which 
appears in rational approximations to functions. 

The error autocorrection effect occurs in all efficient methods of 
rational approximation (e.g., best approximations, Pade approxima- 
^ . tions, multipoint Pade approximations, linear and nonlinear Pade- 

^ I Chebyshev approximations, etc.), where very significant errors in the 

approximant coefficients do not affect the accuracy of this approxi- 
mant. The reason is that the errors in the coefficients of the rational 
approximant are not distributed in an arbitrary way, but form a col- 
lection of coefficients for a new rational approximant to the same ap- 
proximated function. The understanding of this mechanism allows to 
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decrease the approximation error by varying the approximation proce- 
dure depending on the form of the approximant. Results of computer 
experiments are presented. 

The effect of error autocorrection indicates that variations of an 
approximated function under some deformations of rather a general 
type may have little effect on the corresponding rational approximant 
viewed as a function (whereas the coefficients of the approximant can 
have very significant changes). Accordingly, while deforming a func- 
tion for which good rational approximation is possible, the correspond- 
ing approximant's error can rapidly increase, so the property of having 
good rational approximation is not stable under small deformations 
of the approximated functions. This property is "individual", in the 
sense that it holds for specific functions. 

Keywords: error autocorrection, rational approximation, algor- 
ithms, interval estimates. 

AMS Subject classification: 41A20, 65Gxx. 



1 Introduction 

The paper contains a brief survey description of results published in 
(but not all of them) and a new material on a general form of the error 
autocorrection effect and its relation to interval analysis in the spirit of P]- 
|T^. Some old results are presented in a new form. The treatment is partly 
heuristic and it is based on computer experiments. 

The error autocorrection effect means that in a calculation all the inter- 
mediate calculating errors compensate each other, so the final result is much 
more accurate than the intermediate results. In this case standard interval 
estimates (e.g., in the framework of Yu. Matijasevich's a posteriori interval 
analysis) are not realistic, they are too pessimistic. The error autocorrec- 
tion effect appears in some popular numerical methods, e.g., in the least 
squares method. In principle this effect is not new for experts in interval 
computations. We shall discuss a very strong form of the effect. 

For the sake of simplicity let us suppose that we calculate values of a real 
smooth function z = F{yi, ■ ■ ■ , i/n) of real variables yi, - ■ ■ , yn, and suppose 
that all round-off errors are negligible with respect to input data errors. In 
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this case the error AF of the function F can be evaluated by the formula 



^1 % 

dF 
=1 dy^ 



where r is negligible. The sum Y^=\ if' ' ^^^^ formula can be treated as 



a scalar product of the gradient vector {||-} and the vector of errors {A?/j}. 
For all the standard interval methods the best possible estimate for AF is 
given by the formula 



1=1 



This estimate is too pessimistic if both the vectors {|^} and {A?/j} are not 
small but the scalar product is small enough, so these vectors are almost 
orthogonal. That is the case of the error autocorrection effect. To calculate 
values of a function we usually use four arithmetic operations (applying to 
arguments and constants) and this leads to a rational approximation to the 
calculated function. 

The author came across the phenomenon of error autocorrection at the 
end of seventies while developing nonstandard algorithms for computing ele- 
mentary functions on small computers. It was required to construct rational 
approximants of the form 

^ ~ bo + hix + 62^2 + . . . + fe^x"^ ^ ' 

to certain functions of one variable x defined on finite segments of the real 
line. For this purpose a simple method (described in [||] and below) was 
used: the method allows to determine the family of coefficients a^, hj of the 
approximant (1) as a solution of a certain system of linear algebraic equations. 
These systems turned out to be ill conditioned, i.e., the problem of determin- 
ing the coefficients of the approximant is, generally speaking, ill-posed and 
small perturbations of the approximated function f{x) or calculation errors 
lead to very significant errors in the values of coefficients. Nevertheless, the 
method ensures a paradoxically high quality of the obtained approximants 
whose errors are close to the best possible 0, ^. 

For example, for the function cosx the approximant of the form (1) on 
the segment [— 7r/4, 7r/4] obtained by the method mentioned above for m = 4, 
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n = 6 has the relative error equal to 0.55 ■ 10"^^, and the best possible rel- 
ative error is 0.46 ■ 10~^^ The corresponding system of linear algebraic 
equations has the condition number of order 10^. Thus we risk to lose 9 
accurate decimal digits in the solution because of calculation errors. Com- 
puter experiments show that this is a serious risk. The method mentioned 
above was implemented as a Fortran program. The calculations were carried 
out with double precision (16 decimal positions) by means of two different 
computers. These computers are very similar in their architecture, but when 
passing from one computer to another the system of linear equations and the 
computational process are perturbed because of calculation errors, including 
round-off errors. As a result, the coefficients of the approximant mentioned 
above to the function cosx experience a perturbation already at the sixth- 
ninth decimal digits. But the error in the rational approximant itself remains 
invariant and is 0.4 ■ 10~^^ for the absolute error and 0.55 • 10^^^ for the rel- 
ative error. The same thing happens for approximants of the form (1) to 
the function arctanx on the segment [—1, 1] obtained by the method men- 
tioned above for m = 8, n = 9 the relative error is 0.5 ■ lO"'^^ and does not 
change while passing from one computer to another although the correspond- 
ing system of linear equations has the condition number of order 10^^, and 
the coefficients of the approximant experience a perturbation with a relative 
error of order 10~^. 

Thus the errors in the numerator and the denominator of a rational ap- 
proximant compensate each other. The effect of error autocorrection is con- 
nected with the fact that the errors in the coefficients of a rational approx- 
imant are not distributed in an arbitrary way, but form the coefficients of 
a new approximant to the approximated function. It can be easily under- 
stood that all standard methods of interval arithmetic (see, for example, 
[§]-||T0|) do not allow us to take into account this effect and, as a result, 
to estimate the error in the rational approximant accurately (see section 12 
below) . 

Note that the application of standard procedures known in the theory of 
ill-posed problems results in this case in losses in accuracy. For example, if 
one applies the regularization method, then two thirds of the accurate figures 



are lost |T2[; in addition, the amount of calculations increases rapidly. The 
matter of import is that the exact solution of the system of equations in the 
present case is not the ultimate goal; the aim is to construct an approximant 
which is precise enough. This approach allows to "rehabilitate" (i.e., to 
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justify) and to simplify a number of algorithms intended for the construction 
of the approximant, to obtain (without additional transforms) approximants 
in a form which is convenient for applications. 

Professor Yudell L. Luke kindly drew the author's attention to his papers 
|l^] where the effect of error autocorrection for the classical Pade ap- 
proximants was revealed and was explained at a heuristic level. The method 
mentioned above leads to the linear Pade-Chebyshev approximants if the 
calculation errors are ignored. 

In the present paper the error autocorrection mechanism is considered 
for quite a general situation (including linear methods for the construction 
of rational approximants and nonlinear generalized Pade approximations). 
The efficiency of the construction algorithms used for rational approximants 
is due to the error autocorrection effect (at least in the case when the number 
of coefficients is large enough). 

Our new understanding of the error autocorrection mechanism allows us, 
to some extent, to control calculation errors by changing the construction 
procedure depending on the form of the approximant. It is shown that the 
appearance of a control parameter allowing to take into account the error 
autocorrection mechanism ensures the decrease of the calculation errors in 
some cases. 

Construction methods for linear and nonlinear Pade-Chebyshev approx- 
imants involving the computer algebra system REDUCE (see 0) are also 
briefly described. Computation results characterizing the comparative pre- 
cision of these methods are given. With regard to the error autocorrection 
phenomenon the effect described in |0| and connected with the fact that a 
small variation of an approximated function can lead to a sharp decrease in 
accuracy of the Pade-Chebyshev approximants is analyzed. 

The error autocorrection effect occurs not only in rational approximation 
but appears in some other cases (approximate solutions of linear differential 
equations, the method of least squares etc.). In this more general situation 
relations between the error autocorrection effect and standard methods of 
interval analysis are also discussed in this paper. 

The author is grateful to Y.L. Luke, B.S. Dobronets, and S.P Shary 
for stimulating discussions and comments. The author wishes to express 
his thanks to I. A. Andreeva, A. Ya. Rodionov and V. N. Fridman who 
participated in the programming and organization of computer experiments. 
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2 Error auto correct ion in rational approxi- 
mation 



Let {(fo, ifi, . . . , ipn} and {-00) '4'it ■ ■ ^ '4'm} be two collections consisting of lin- 
early independent functions of the argument x belonging to some (possibly 
multidimensional) set X. Consider the problem of constructing an approxi- 
mant of the form 

= 1 — ; ; — ; ; — r- (2) 

bolpQ + hlPi + ... + bmlpm 

to a given function f{x) defined on X. If X coincides with a real line segment 
[A, B] and if = and ipk = for all /c, then the expression (2) turns out 
to be a rational function of the form (1) (see the Introduction). It is clear 
that expression (2) also gives a rational function in the case when we take 
Chebyshev polynomials or, for example, Legendre, Laguerre, Hermite, etc. 
polynomials as </?fe and ■0^. 

Fix an abstract construction method for an approximant of the form 
(2) and consider the problem of computing the coefficients a^, hj. Quite 
often this problem is ill-conditioned (ill-posed). For example, the problem of 
computing coefficients for best rational approximants (including polynomial 
approximants) for high degrees of the numerator or the denominator is ill- 
conditioned. 

The instability with respect to the calculation error can be related both 
to the abstract construction method of approximation (i.e., with the for- 
mulation of the problem) and to the particular algorithm implementing the 
method. The fact that the problem of computing coefficients for the best 
approximant is ill-conditioned is related to the formulation of this problem. 
This is also valid for other construction methods for rational approximants 
with a sufficiently large number of coefficients. But an unfortunate choice 
of the algorithm implementing a certain method can aggravate troubles con- 
nected with ill-conditioning. 

Let the coefficients a^, hj give an exact or an approximate solution of this 
problem, and let the Sj, hj give another approximate solution obtained in the 
same way. Denote by Aa,, A6j the absolute errors of the coefficients, i.e., 
Acj — di — Gi, Ahj = hj — hj] these errors arise due to perturbations of the 
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approximated function /(x) or due to calculation errors. Set 



APjx) = Er=oAa,<^,, AQ{x) = ET=o^b,^j, 
P{x) = P + AP, Q{x) = Q + AQ. 

It is easy to verify that the following exact equality is valid: 

p + ap p_aq(ap p\ 
q + aq~q~~q\aq~q)' 



(3) 



As mentioned in the Introduction, the fact that the problem of calculating 
coefficients is ill-conditioned can nevertheless be accompanied by high accu- 
racy of the approximants obtained. This means that the approximants P/Q 
and P/Q are close to the approximated function and, therefore, are close 
to each other, although the coefficients of these approximants differ greatly. 
In this case the relative error AQ/Q = AQ/{Q + AQ) of the denominator 
considerably exceeds in absolute value the left-hand side of equality (3). This 
is possible only in the case when the difference AP/ AQ — P/Q is small, i.e., 
the function AP/ AQ is close to P/Q, and, hence, to the approximated func- 
tion. Thus the function AP/ AQ will be called the error approximant. For 




a special case, this concept was actually introduced in [|T3]. For "efficient" 
methods, the error approximant provides indeed a good approximation for 
the approximated function and, thus, P/Q and P/Q differ from each other 
by a product of small quantities in the right-hand side of (3). 
Usually the following "uncertainty relation" is valid: 

/AP P\ /AP \ 

where 6Q = q'^'^q is the relative error of the denominator Q, the difference 
^ — / is the absolute error of the error approximate ^ to the function /, 
and e is the absolute "theoretical" error of our method; the argument x can 
be treated as fixed. 

Usually the approximation function f{x) is treated as an element of a 
Banach space with a norm || • || and the absolute error A of the approximant 
(2) is defined as A = ||/ — ^||; so its relative error 5 is defined as S = 
IK/ — ^)// II or 6 = IK/ — ^)/§||- In what follows, we shall consider the 



7 



space C[A, B] of all continuous functions defined on the real line segment 
[A, B] with the norm 



ll/WII 



max \f(x)\. 

A<x<B l'^ ^ ^1 



Below we discuss examples of the error autocorrection effect for linear and 
nonlinear methods of rational approximation. 



3 Error autocorrection for linear methods in 
rational approximation 

Several construction methods for approximants of the form (2) are connected 
with solving systems of linear algebraic equations. This procedure can lead 
to a large error if the corresponding matrix is ill-conditioned. Consider an 
arbitrary system of linear algebraic equations 



Ay = h, 



(4) 



where A is a given square matrix of order N with components Uij {i^j — 
1, . . . , A^), h is a given vector column with components hi, and y is an un- 
known vector column with components Define the vector norm by the 
equality 

N 

\\y\\ = H 

i=l 



(this norm is more convenient for calculations than 
the matrix norm is determined by the equality 



xl + 



+ x%). Then 



\A\ 



max \\Ay\\ 



N 

max II a, 

l<i<Af ^ 



If a matrix A is nonsingular, then the quantity 

cond{A) = \\A\\ ■ \\A~^\ 



(5) 
Since 



is called the condition number of the matrix A (see, for example, [T^ 
y = A~^h, we see that the absolute error Ay of the vector y is connected 
with the absolute error of the vector h by the relation Ay = A^^Ah, whence 



||Ay|| < \\A-'\\-\\Ah\ 
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and 

l|Ai/||/||y||<||A-i||-(||/.||/||z/||)(||A/^||/||/^||). 
Taking into account the fact that \\h\\ < \\A\\ ■ \\y\\, we finally obtain 

l|A|/||/|b||<P||.||A-i||.||A/.||/||/.||, (6) 

i.e., the relative error of the solution y is estimated via the relative error of 
the vector h by means of the condition number. It is clear that (6) can turn 
into an equality. Thus, if the condition number is of order 10*^, then, because 
of round-off errors in h, we can lose k decimal digits of y. 

The contribution of the error of the matrix A is evaluated similarly. Fi- 
nally, the dependence of cond{A) on the choice of a norm is weak. A method 



of rapid estimation of the condition number is described in |]T5|, Section 3.2. 

Let an abstract construction method for the approximant of the form 
(2) be linear in the sense that the coefficients of the approximant can be 
determined from a homogeneous system of linear algebraic equations. The 
homogeneity condition is connected with the fact that, when multiplying 
the numerator and the denominator of fraction (2) by the same nonzero 
number, the approximant (2) does not change. Denote by y the vector whose 
components are the coefficients oq, ai, . . . , a„, 6o, • • • , ^m- Assume that the 
coefficients can be obtained from the homogeneous system of equations 

Hy = 0, (7) 

where if is a matrix of dimension (m + n + 2) x (m + n + 1). 

The vector y is an approximate solution of system (7) if the quantity 
\\Hy\\ is small. If y and y are approximate solutions of system (7), then 
the vector Ay = y — y is also an approximate solution of this system since 
||ifA?/|| = \\Hy — Hy\\ < \\Hy\\ + Thus it is natural to assume that 

the function AP/AQ corresponding to the solution Ay is an approximant to 
f{x). It is clear that the order of the residual of the approximate solution 
Ay of system (7), i.e., of the quantity ||ifA?/||, coincides with the order of 
the largest of the residuals of the approximate solutions y and y. For a fixed 
order of the residual the increase of the error Ay is compensated by the fact 
that Ay satisfies the system of equations (7) with greater "relative" accuracy, 
and the latter, generally speaking, leads to the increase of accuracy of the 
error approximant. 
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To obtain a certain solution of system (7), one usually adds to this system 
a normalization condition of the form 



^ Aitti + = 1, (8) 

i=0 j=0 

where Aj, fij are numerical coefficients. As a rule, the relation fog = 1 is taken 
as the normalization condition (but this is not always successful with respect 
to minimizing the calculation errors). 

Adding equation (8) to system (7), we obtain a nonhomogeneous system 
of m+n+2 linear algebraic equations of type (4). If the approximate solutions 
y and y of system (7) satisfy condition (8), then the vector Ay satisfies the 
condition 

n m 

J2\iAai + Y.fx,Abj=0. (9) 

i=0 j=0 

Of course, the above reasoning is not very rigorous; for each specific con- 
struction method for approximations it is necessary to carry out some addi- 
tional analysis. More accurate arguments are given below for the linear and 
nonlinear Pade-Chebyshev approximants. The presence of the error autocor- 
rection mechanism described above is also verified by numerical experiments 
(see below). 

It is clear, that classical Fade approximations, multipoint Fade approxi- 
mations, linear generalized Fade approximations in sense of (e.g., linear 
Fade-Chebyshev approximations) give us good examples of hnear methods 
in rational approximation. From our point of view, methods of the best ap- 
proximations can be treated as linear. The thing is that the coefficients of 
the best Chebyshev approximant satisfy a system of linear algebraic equa- 
tions and are computed as approximate solutions of this system on the last 



step of the iteration process in algorithms of Remez's type (see 0, |T3 for 
details). Thus, the construction methods for the best rational approximants 
can be regarded as linear. At least for some functions (say, for cos((7r/4)a:), 
— 1 < X < 1) the linear and the nonlinear Fade-Chebyshev approximants are 
very close to the best ones in the sense of the relative and the absolute errors, 
respectively. The results that arise when applying calculation algorithms for 
Fade-Chebyshev approximants can be regarded as approximate solutions of 
the system which determines the best approximants. Thus the presence of 
the effect of error autocorrection for Fade-Chebyshev approximants gives an 
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additional argument in favor of the conjecture that this effect also takes place 
for the best approximants. 

Finally, note that the basic relation (3) becomes meaningless if one seeks 
an approximant in the form floV^o + o-i^i + • • • + dn^n) i-e., the denominator 
in (2) is reduced to 1. However, in this case the effect of error autocorrection 
(although much weakened) is also possible; this is connected with the fact 
that the errors Aoj approximately satisfy certain relations. Such a situation 
can arise when using the least squares method. 

4 Linear Pade— Chebyshev approximations 
and the PADE program 

Let us start to discuss a series of examples. Consider the approximant of the 
form (1) 

ao + aix + a2X^ + . . . + OnX" , . 

6o + Oix + 622;^ + . . . + hmX"^ 
to a function f{x) defined on the segment [—1, 1]. The absolute error function 

A(x) = f{x) - Rm,n{^) 

obviously has the following form: 

A(a;) = $(x)/Q„(x), 

where 

^{X) = f{x)Qm{x)-P^{x). (11) 

The function Rm,n{x) = Pn{x)/Qm{x) is called the linear Pade- Chebyshev 
approximant to the function f{x) if 

1 

J ^x)Tk{x)w{x) dx = 0, /c = 0, 1, . . . , m + n, (12) 
-1 

where Tfc(x) = cos(narccosa;) are the Chebyshev polynomials, w{x) = — x^. 

This concept allows a generalization to the case of other orthogonal polyno- 
mials (see, e.g., [|l6l, |jT8|-|20|). Approximants of this kind always exist [|l^ . 
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The system of equations (12) is equivalent to the following system of linear 
algebraic equations with respect to the coefficients aj, bj: 



1 . X „/ s „ 1 



^ f x^T,{x)f{x) ^ " fx^Tkix) 
2^^n j^^dx-}_^ai ^==dx = Q. 13 



The homogeneous system (12) can be transformed into a nonhomogeneous 
one by adding a normalization condition; in particular, any of the following 
relations can be taken as this condition: 

6o = 1, (14) 
bm = 1, (15) 
am = 1- (16) 

In [|T], 1^ the program PADE (in Fortran, with double precision) which allows 
us to construct rational approximants by solving the system of equations 
of type (13) is briefly described. The complete text of a certain version of 
this program and its detailed description can be found in the Collection of 
algorithms and programs of the Research Computer Center of the Russian 
Academy of Sciences . For even functions the approximant is looked for in 
the form 

Qq + aix^ + . . . + a„(x^)" 
bo + bix'^ + . . . + bmix^ 
and for odd functions it is looked for in the form 



UQ^uix -r . . . -r u„,i^x ; , . 



ao + aix^ + . . . + an{x^) _v 

Rix) = X- ; ; , , (18) 

^ ^ bo + bix^ + ... + bm{x^)"^' ^ ' 

respectively. The program computes the values of coefficients of the ap- 
proximant, the absolute and the relative errors A = max^<a.<^ 1^(2^)1 S'lid 
(5 = max^<j.<B |A(x)//(x)|, and gives the information which allows us to 
estimate the quality of the approximation (see and |^ for details). Using 
a subroutine, the user introduces the function defined by means of any al- 
gorithm on an arbitrary segment [A, 5], introduces the boundary points of 
this segment, the numbers m and n, and the number of control parameters. 
In particular, one can choose the normalization condition of type (14)-(16), 
look for an approximant in the form (17) or (18) and so on. The change of 
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the variable reduces the approximation on any segment [A, B] to the approx- 
imation on the segment [—1, 1]. Therefore, we shall consider the case when 
A — —1, B — 1 in the sequel unless otherwise stated. 

For the calculation of integrals, the Gauss-Hermite-Chebyshev quadra- 
ture formula is used: 

i^^'^-^sPi-''^"^^ '''' 

where s is the number of interpolation points; for polynomials of degree 2s — 1 
this formula is exact, so the precision of formula (19) increases rapidly as the 
parameter s increases and depends on the quality of the approximation of 
the function ip{s) by polynomials. To calculate the values of Chebyshev 
polynomials, the well-known recurrence relation is applied. 

If the function f{x) is even and an approximant is looked for the form (17), 
then system (13) is transformed into the following system of equations: 

where k = 0,1, . . . ,m -\- n. If f{x) is an odd function and an approximant is 
looked for in the form (18), then, first, by means of the solution of system (20) 
complemented by one of the normalization conditions, one determines an 
approximant of the form (17) to the even function f{x)/x, and then the 
obtained approximant is multiplied by x. This procedure allows us to avoid 
a large relative error for x = 0. 

This algorithm is rather simple; for its implementation only two standard 
subroutines are needed (for solving systems of linear algebraic equations and 
for numerical integration). However, the algorithm is efficient. 

The possibihties of the FADE program are demonstrated in Table 1. 
This table contains errors of certain approximants obtained by means of this 
program. 
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Table 1 



Fiinrtion 


ni 


n 


A 


s 


^min 


V *^ 


2 


2 


0.8 ■ lO"*^ 


1.13 ■ lO"*^ 


0.6 ■ 10-*^ 


V 


3 


3 


1.9 ■ 10"^ 


2.7 • 10-9 


1.12 ■ 10-9 


COS — T 

vj ^ lA/ 





3 


0.28 ■ 10"'^ 


0.39 ■ 10-'^ 


0.32 ■ 10-'^ 


COS — T 


1 


2 


0.24 ■ 10"'^ 


0.34 ■ 10-'^ 


0.29 ■ 10-'^ 


cos — T 

v_y i_/ ^ 


2 


2 


0.69 ■ 10"^° 


0.94 ■ 10-^° 


0.79 ■ 10-1° 


TT 





5 


0.57 ■ 10"^^ 


0.79 ■ 10-^^ 


0.66 ■ 10-1^ 


TT 


2 


3 


0.4 ■ 10^^^ 


0.55 ■ 10"^^ 


0.46 ■ 10-1^ 







4 


0.34 ■ 10"^^ 


0.48 • 10"-^^ 


0.47 ■ 10-" 


sin — T 


2 


2 


0.32 ■ 10"^^ 


0.45 • 10-" 


0.44 ■ 10-" 


TT 





5 


0.36 • 10"^^ 


0.55 ■ 10"^^ 


0.45 ■ 10-1^ 


sin — T 


1 


1 


0.14 ■ 10^^ 


0.14 ■ 10-^ 


0.12 ■ 10-^ 


sm -^x 





4 


0.67 ■ 10"^ 


0.67 ■ 10-® 


0.54 ■ 10-® 


sin -^x 


2 


2 


0.63 ■ 10"® 


0.63 ■ 10"® 


0.53 ■ 10-® 


sin |x 


3 


3 


0.63 • 10-^^ 


0.63-10-^^ 


0.5 • 10-1^ 


tan ^x 


1 


1 


0.64 • 10-5 


0.64 ■ 10-5 


0.57-10-5 


tan 


2 


1 


0.16 ■ 10"^ 


0.16 ■ 10-^ 


0.14- 10-^ 


tan jX 


2 


2 


0.25 • 10"^° 


0.25 • 10-^° 


0.22 • 10-1° 


arctan x 





7 


0.75 ■ 10-^ 


10-^ 


10-^ 


arctan x 


2 


3 


0.16-10-^ 


0.51 ■ 10"^ 


0.27-10-^ 


arctan x 





9 


0.15 ■ 10-® 


0.28 ■ 10-® 


0.23 ■ 10-® 


arctan x 


3 


3 


0.54-10-9 


1.9 ■ 10-9 


0.87-10-9 


arctan x 


4 


4 


0.12 ■ 10-" 


0.48 ■ 10-" 


0.17- 10-" 


arctan x 


5 


4 


0.75 • 10-1=^ 


3.7-10-1=' 


0.71 • 10-13 



For every approximant, the absolute error A, the relative error 6, and (for 
comparison) the best possible relative error 6mm taken from [|11[] are indicated. 
The function ^/x is approximated on the segment [1/2, 1] by the expression 
of the form (1), the function cos ^x is approximated on the segment [—1, 1] 
by the expression of the form (17), and all the others are approximated on 
the same segment by the expression of the form (18). 
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5 Error autocorrection for the PADE pro- 



gram 

The condition numbers of systems of equations that arise while calculating, 
by means of the PADE program, the approximants considered above are very 
large: for example, while calculating the approximant of the form (18) on 
the segment [—1,1] to sin |x for m = = 3, the corresponding condition 
number is of order 10^^. As a result, the coefficients of the approximant 
are determined with a large error. In particular, a small perturbation of the 
system of linear equations arising when passing from one computer to another 
(because of the calculation errors) gives rise to large perturbations in the 
coefficients of the approximant. Fortunately, the effect of error autocorrection 
improves the situation, and the errors of the approximant have no substantial 
changes under this perturbation. This fact is described in the Introduction, 
where concrete examples are also given. 

Consider some more examples connected with passing from one computer 
to another (see |^ for details). The branch of the algorithm which cor- 
responds to the normalization condition (14) (i.e., to bo = 1) is considered. 
For arctanx the calculation of an approximant of the form (18) on the seg- 
ment [—1, 1] for m = n = 5 gave an approximant with the absolute error 
A = 0.35 ■ 10~^^ and the relative error 6 = 0.16 ■ 10^^^. The correspond- 
ing system of linear algebraic equations has the condition number of order 
10^°! Passing to another computer we obtain the following: A = 0.5 ■ 10~^^, 
6 = 0.16 • 10~^^, the condition number is of order 10^^, and the errors Aai 
and Abi in the coefficients ai and hi in (18) are greater in absolute value than 
1! This example shows that the problem of computing the condition num- 
ber of an ill-conditioned system is, in its turn, ill-conditioned. Indeed, the 
condition number is, roughly speaking, determined by values of coefficients 
of the inverse matrix, every column of the inverse matrix being the solution 
of the system of equations with the initial matrix of coefficients, i.e., of an 
ill-conditioned system. 

Consider in detail the effect of error autocorrection for the approximant 
of the form (17) on the segment [—1,1] to the function cos |a; for m = 2, 
n = 3. For our two different computers, two different approximants were 
obtained with the coefficients aj,6j and di,bi respectively. In the both cases 
the calculation number is of order 10^, absolute error 6 = 0.55 ■ 10^^^; these 
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errors are closed to the best possible. The coefficients of the approximants 
obtained by means of the computers mentioned above and the coefficients of 
the error approximant (see Section 3 above) are as follows: 



oo = 0.9999999999999600, Oq = 0.9999999999999610, 
Aao = -10-^^ 

oi = -0.2925310453579570, Oi = -0.2925311264716216, 
Aai = 10-^ • 0.811136646, 

02 = 10-^ • 0.1105254254716866, = 10"^ • 0.1105256585556549, 

Aa2 = -10-^ • 0.2330839683, 

03 = 10-^ • 0.1049474500904401, 0,3 = 10"^ • 0.1049482094850086, 

Aag = 10"^ ■ 0.7593947685, 
60 = 1, bo = 1, 
A60 = 0, 

61 = 10"^ • 0.1589409217324021, h = 10"^ ■ 0.1589401105960337, 

Abi = 10"^ • 0.8111363684, 

62 = 10-^ • 0.1003359011092697, 62 = 10"^ • 0.1003341918083529, 

Ab2 = 10-^ • 0.17093009168. 
Thus, the error approximant has the form 

AP _ Aoo + Aoix^ + Aa2a;'^ + Aa3a;^ 

AQ~ AMM^A6^^4 ■ i ) 

If the relatively small quantity Aao = — 10~^^ in (21) is omitted, then, as 
testing by means of a computer shows (2000 checkpoints), this expression 
is an approximant to the function cos on the segment [—1,1] with the 
absolute and the relative errors A = 5 — 0.22 • 10~^. 

But the polynomial AQ is zero at a; = 0, and the polynomial AP takes a 
small, but nonzero value at a; = 0. Fortunately, relation (3) can be rewritten 
in the following way: 

P_P^AP_AQ P 

Q Q Q Q Q' ^ ^ 
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Thus, as AQ 0, the effect of error autocorrection arises because the quan- 
tity AP is close to zero, and the error of the approximant P/Q is determined 
by the error of the coefficient Oq. The same situation also takes place when 
the polynomial AQ vanishes at an arbitrary point Xq belonging to the seg- 
ment [A, B] where the function is approximated. It is clear that if one chooses 
the standard normalization {be = 1), then the error approximant has actu- 
ally two coefficients less than the initial one. It is clear that in the general 
case the normalization conditions = 1 or 6^ = 1 result in the following: 
the coefficients of the error approximant form an approximate solution of the 
homogeneous system of linear algebraic equations whose exact solution deter- 
mines the Pade-Chebyshev approximant having one coefficient less than the 
initial one. The effect of error autocorrection improves again the accuracy of 
this error approximant; thus, "the snake bites its own tail". A situation also 
arises in the case when the approximant of the form (17) to an even function 
is constructed by solving the system of equations (20). 

Sometimes it is possible to decrease the error of the approximant by 
means of the fortunate choice of the normalization condition. As an example, 
consider the approximation of the function on the segment [—1,1] by 
rational functions of the form (1) for m — 15, n — 0. For the traditionally 
accepted normalization Bq = 1, the PADE program yields an approximant 
with the absolute error A = 1.4 ■ 10^^^ and the relative error 6 = 0.53 ■ 10~^^. 
After passing to the normalization condition 615 = 1, the errors are reduced 
nearly one half: A = 0.73 • 10"^^, 6 = 0.27 • lO^^l Note that the condition 
number increases: in the first case it is 2 • 10^, and in the second case it is 
6 ■ 10^^. Thus the error decreases notwithstanding the fact that the system of 
equations becomes drastically ill-conditioned. This example shows that the 
increase of accuracy of the error approximant can be accompanied by the 
increase of the condition number, and, as experiments show, by the increase 
of errors of the numerator and the denominator of the approximant. The 
fortunate choice of the normalization condition depends on the particular 
situation. 

A specific situation arises when the degree of the numerator (or of the 
denominator) of the approximant is equal to zero. In this case the unfortu- 
nate choice of the normalization condition results in the following: the error 
approximant becomes zero or is not well-defined. For n = it is expedient to 
choose condition (15), as it was done in the example given above. For m = 
(the case of the polynomial approximation) it is usually expedient to choose 
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condition (16). 

One could seek the numerator and the denominator of the approximant 
in the form 

n m 

P = Y.a,T,, Q = J2bjTj, (23) 

i=0 j=0 

where Tj are the Chebyshev polynomials. In this case the system of linear 
equations determining the coefficients would be better conditioned. But the 
calculation of the polynomials of the form (23) by, for example, the Chen- 
shaw method, results in lengthening the computation time, although it has 
a favorable effect upon the error of calculations. The transformation of the 
polynomials P and Q from the form (23) into the standard form also requires 
additional efforts. 

In practice it is more convenient to use approximants represented in the 
form (1), (17), or (18), and calculate the fraction's numerator and denomi- 
nator according the Horner scheme. In this case the normalization a„ = 1 or 
6m = 1 allows to reduce the number of multiplications. 

The use of the algorithm does not require that the approximated function 
be expanded into a series or a continued fraction beforehand. Equations (12) 
or (13) and the quadrature formula (19) show that the algorithm uses only 
the values of the approximated function f{x) at the interpolation points of 
the quadrature formula (which are zeros of some Chebyshev polynomial). 

On the segment [—1, 1] the linear Pade-Chebyshev approximants give a 
considerably smaller error than the classical Fade approximants. For exam- 
ple, the Fade approximant of the form (1) to the function for m = n = 2 
has the absolute error A(l) = 4 ■ 10-3 at the point x = 1, but the FADE 
program gives an approximant of the same form with the absolute error 
A = 1.9 ■ 10"^ (on the entire the segment), i.e., the latter is 20 times 
smaller than the previous one. The absolute error of the best approximant 
is 0.87 ■ 10"^ 



6 The "cross— multiplied" linear Pade— Cheb- 
yshev approximation 

As a rule, linear Fade-Chebyshev approximants are constructed according 
to the following scheme, see, e.g., |^ |Tl|, [1^. Let the approximated function 
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be decomposed into the series in Chebyshev polynomials 

OO 

f(x) = CiTi{x) = -Co + ciT,{x) + C2T2{x) + . . . , (24) 

i=0 ^ 

m 

where the notation YL' means that the first term uq in the sum is replaced 

i=oo 

by Uq/2. The rational approximant is looked for in the form 

n 

Y! aiTi{x) 

Rix) = ^ ; (25) 

E'b,T,{x) 

j=0 

the coefficients bj are determined by means of the system of linear algebraic 
equations 

m 

^ 6j(cj+j- + C|j_j|) = 0, i ^ n+ 1, . . . ,n + m, (26) 

i=o 

and the coefficients Oj are determined by the equalities 

^i^oYl bji^i+j + C|i-j|) = 0, i = 0, 1, . . . , n. (27) 

It is not difficult to verify that this algorithm must lead to the same results 
as the algorithm described in Section 5 if the calculation errors are not taken 
into account. 

The coefficients for A; = 0, 1, . . . , n + 2m, are present in (26) and (27), 
i.e., it is necessary to have the first n + 2m + 1 terms of series (24). The 
coefiicients Ck are known, as a rule, only approximately. To determine them 
one can take the truncated expansion of f{x) into the scries in powers of x 
(the Taylor series) and by means of the well-known economization procedure 
transform it into the form 

n+2m 
1=0 
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7 Nonlinear Pade— Chebyshev approximations 



A rational function R{x) of the form (1) or (25) is called a nonlinear Pade- 
Chebyshev approximant to the function f{x) on the segment [—1, 1], if 

1 

{f{x) — R{x))Tk{x)w{x)dx = 0, k = 0,1, . . . ,m + n, (29) 
-1 

where Tk{x) are the Chebyshev polynomials, w{x) = \ j \J\ — x^. 

In the paper ||2^ the following algorithm of computing the coefficients of 
the approximant indicated above is given. Let the approximated function 
f{x) be expanded into series (24) in Chebyshev polynomials. Determine the 
auxiliary quantities 7^ from the system of linear algebraic equations 

7jC|fc_j| =0, = n + 1, n + 2, . . . , n + m, (30) 

i=o 

assuming that 70 = 1. The coefficients of the denominator in expression (25) 
are determined by the relations 



= 7i7i 



j=0 



where /i"^ = l/2X]r=i7i^j ^^is implies 60 = 2. Finally, the coefficients of the 
numerator are determined by formula (27). It is possible to solve system (30) 
explicitly and to indicate the formulas for computing the quantities 7^. One 
can also estimate explicitly the absolute error of the approximant. This 
algorithm is described in detail in the book ||2^; see also |jl6|. 



In contrast to the linear Pade-Chebyshev approximants, the nonlinear 
approximants of this type do not always exist, but it is possible to indicate 
explicitly verifiable conditions guaranteeing the existence of such approxi- 
mants pO|. The nonlinear Pade-Chebyshev approximants (in comparison 



with the linear ones) have, as a rule, a somewhat smaller absolute errors, but 
can have larger relative errors. Consider, as an example, the approximant of 
the form (1) or (25) to the function on the segment [—1, 1] for m = n = 3. 
In this case the absolute error for a nonlinear Pade-Chebyshev approximant 
is A = 0.258 ■ 10~^, and the relative error, 5 = 0.252 ■ 10~^; for the linear 
Pade-Chebyshev approximant A = 0.33 ■ 10~^ and 5 = 0.20 ■ 10~®. 
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8 Applications of the computer algebra sys- 
tem REDUCE to the construction of ratio- 
nal approximants 



The computer algebra system REDUCE ||23| allows us to handle formulas at 
symbolic level and is a convenient tool for the implementation of algorithms 
of computing rational approximants. The use of this system allows us to 
bypass the procedure of working out the algorithm of computing the approx- 
imated function if this function is presented in analytical form or when the 
Taylor series coefficients are known or are determined analytically from a dif- 
ferential equation. The round-off errors can be eliminated by using the exact 
arithmetic of rational numbers represented in the form of ratios of integers. 

Within the framework of the REDUCE system, the program package 
for enhanced precision computations and construction of rational approxi- 
mants is implemented; see, for example 0]. In particular, the algorithms 
from Sections 6 and 7 (which have similar structure) are implemented, the 
approximated function being first expanded into the power (Taylor) series, 
/ = E^o/^^nO)a;V^!, and then the truncated series 

N k 

E/^'nO)|^, (31) 

fc=0 

consisting of the first iV + 1 terms of the Taylor series (the value is deter- 
mined by the user) being transformed into a polynomial of the form (28) by 
means of the economization procedure. 

The algorithms implemented by means of the REDUCE system allow us 
to obtain approximants in the form (1) or (25), estimates of the absolute 
and the relative error, and the error curves. The output includes the For- 
tran program of computing the corresponding approximant, the constants of 
rational arithmetic being transformed into the standard fioating point form. 
When computing the values of the obtained approximant, this approximant 
can be transformed into the form most convenient for the user. For example, 
one can calculate values of the numerator and the denominator of the frac- 
tion of the form (1) according to the Horner scheme, and for the fraction of 
the form (25), according to Clenshaw's scheme, and transform the rational 
expression into a continued fraction or a Jacobi fraction as well. 
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The ALGOL-like input language of the REDUCE system and convenient 
tools for solving problems of linear algebra guarantee simplicity and compact- 
ness of the programs. For example, the length of the program for computing 
linear Pade-Chebyshev approximants is 62 lines. 

9 Error approximants for linear and nonlin- 
ear Pade— Chebyshev approximations 

Relations (29) can be regarded as a system of equations for the coefficients 
of the approximant. Let the approximants R{x) = P{x)/Q{x) and R{x) = 
P{x)/Q{x), where P{x), P{x) are polynomials of degree n and Q{x), Q{x) are 
polynomials of degree m, be obtained by approximate solving the indicated 
system of equations. Consider the error approximant AP{x)/ AQ{x), where 
AP{x) = P{x) - P{x), AQ{x) = Q{x) - Q{x). Substituting R{x) and R{x) 
in (29) and subtracting one of the obtained expressions from the other, we 
see that the following approximate equality holds: 



-1 



which directly implies that R{x) — R[x) is clause to zero. This and the 
equality (3) imply the approximate equality 

](AP{x) P(x)\AQ^,, 



where k = 0,1, . . . , m+n, w{x) = — x^. If the quantity AQ is relatively 

not small (this is connected with the fact that the system of equations (30) 
is ill-conditioned), then, as follows from equality (32), we can naturally ex- 
pect that the error approximant is close to P/Q and, consequently, to the 
approximated function f{x). 

Due to the fact that the arithmetic system of rational numbers is used, the 
software described in Section 7 allows us to eliminate the round-off errors and 
to estimate the "pure" influence of errors in the approximated function on 
the coefficients of the nonlinear Pade-Chebyshev approximant. In this case 
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the effect of error autocorrection can be substantiated by a more accurate 
reasoning which is vahd both for nonhnear Pade-Chebyshev approximants 
and for hnear ones, and even for the hnear generahzed Pade approximants 
connected with different systems of orthogonal polynomials. This reasoning 
is analogous to Y. L. Luke's considerations |13| for the case of classical Pade 
approximants. 

Assume that the function f{x) is expanded into series (24) and that the 
rational approximant R{x) = P{x)/Q{x) is looked for in the form (25). 

Let Abj be the errors in coefficients of the approximant's denominator Q. 
In the linear case these errors arise when solving the system of equations (26), 
and in the nonlinear case, when solving the system of equations (27). In both 
the cases the coefficients in the approximant's numerator are determined by 
equations (27), whence we have 



Atti 



-I m 

W'Ab 



'j{Ci+j + C|i_j|), 



0,1,..., n. 



(33) 



This implies the following fact: the error approximant AP/AQ satisfies the 
relations 



{f{x)AQ{x) - AP{x))Ti{x)w{x) dx = 0, 



0,1, 



,n. 



(34) 



which are analogous to relations (12) defining the linear Pade-Chebyshev 
approximants. Indeed, let us use the well-known multiplication formula for 
Chebyshev polynomials: 



Ti{x)Tj{x) = -[Ti+j\ 



X 



+ 2],_j|(x)]. 



(35) 



where i, j are arbitrary indices; see, for example [|T6|, |2^. Taking (35) into 
account, the quantity fAQ — AP can be rewritten in the following way: 

m oo n 

fAQ -AP= (Y.'^b,TA [Y^'c^tA - J2'Aa,T, 



2j 



i=0 '-j=o 



i=0 
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This formula and (33) imply that 

/AQ- AP = 0(T„+i), (36) 

i.e., in the expansion of the function /AQ — AP into the series in Chebyshev 
polynomials, the first n + 1 terms are absent, and the latter is equivalent to 
relations (34) by virtue of the fact that the Chebyshev polynomials form an 
orthogonal system. 

Consider an arbitrary rational function of the form (1) or (8) 

^ _ gp + aix H h ana;" _ Pn{,x) 

h^ + hix^ h Qm{,x) ' 

We shall say that Rm,n{x) is a generalized linear Fade- Chebyshev approximant 
of order N to the function f{x) if 

J^^ ^{x)Tk{x)w{x)dx = 0, A; = 0, 1, ■ ■ ■ , iV, 

where Tk{x) = cos(narccosa;) are the Chebyshev polynomials, w{x) = — x'^, 

^{x) = f{x)Qm{x) — Pn{x). This means that the first + 1 terms in the ex- 
pansion of the function $(x) into the series in Chebyshev polynomials ("the 
Fourier- Chebyshev series") are absent, i.e. 

f{x)Qm{x)-Pn{x)=0{TM+l). 

If N = m + n, then we have the usual linear Fade- Chebyshev approximant 
discussed above in Section 4. Formula (36) means that the following result 
is valid. 

Theorem. Let ^ be the error approximant to f{x) generated by the 
approximant (25) for the case of linear or nonlinear Pade-Chebyshev ap- 
proximation and algorithms described in Sections 6 and 7. Then this error 
approximant ^ is a generalized linear Pade- Chebyshev approximant of order 
n to the function f{x). 

An equivalent result was discussed in [§, When carrying out actual 
computations, the coefficients q are known only approximately, and thus the 
equalities (33), (34) and (35) are also satisfied approximately. 
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10 Computer experiments for the nonlinear 
Pade— Chebyshev approximation 

Consider the results of computer experiments that were performed by means 
of the software implemented in the framework of the REDUCE system and 
briefly described in Section 7 above. At the author's request, computer 
calculations were carried out by A. Ya. Rodionov. We begin with the example 
considered in Section 5 above, where the linear Pade-Chebyshev approximant 
of the form (17) to the function cos |x was constructed on the segment 
[— 1, 1] for m = 2, n = 3. To construct the corresponding nonlinear Pade- 
Chebyshev approximant, it is necessary to specify the value of the parameter 

determining the number of terms in the truncated Taylor series (31) of 
the approximated function. In this case the calculation error is determined, 
in fact, by the parameter N. 

The coefficients in approximants of the form (17) which are obtained for 
A" = 15 and N — 20 (the nonlinear case) and the coefficients in the error 
approximant are as follows: 

ao = 0.4960471034987563, ao = 0.4960471027757504, 

Aao = 10"^ ■ 0.07230059, 
di = -0.1451091945278387, Oi = -0.1451091928755736, 
Aai = -10-^ • 0.16522651, 
02 = 10"^ • 0.5482586543334515, a2 = 10"^ • 0.548258121085953, 
Aoa = -10-^ • 0.42224856, 
Qg = -10"^ • 0.5205903601778259, as = -10"^ ■ 0.5205902238186334, 

Aaa = -10~^°- 0.13635919, 
bo = 0.4960471034987759, bo = 0.4960471027757698, 
Abo = 10"^ • 0.07230061, 
bi = 10-^ • 0.7884201590727615, bi = 10"^ • 0.7884203019999351, 

Abi = -10^^° -0.1429272, 
62 = 10"^ ■ 0.4977097973870693, 62 = 10"^ ■ 0.4977100977750249, 
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Ab2 = -10"^° ■ 0.300388. 

Both the approximants have absolute errors A equal to 0.4 ■ 10^^^ and 
the relative errors 6 equal to 0.6 • 10"^^, these values being close to the best 
possible. The condition number of the system of equations (30) in both the 
cases is 0.4 • 10^. The denominator AQ of the error approximant is zero for 
X = xq ^ 0.70752 . . .; the point xo is also close to the root of the numerator 
AP which for x = xq is of order lO"^. Such a situation was considered in 
Section 5 above. Outside a small neighborhood of the point xq the absolute 
and the relative errors have the same order as in the "linear case" considered 
in Section 5. 

Now consider the nonlinear Padc-Chcbyshcv approximant of the form 
(17) on the segment [—1, 1] to the function tan |x for m = n = 3. In this case 
the Taylor series converges very slowly, and, as the parameter N increases, the 
values of coefficients of the rational approximant undergo substantial (even 
in the first decimal digits) and intricate changes. The situation is illustrated 
in Table 2, where the following values are given: the absolute errors A, 
the absolute errors Aq of error approximants (there the approximants are 
compared for = 15 and N = 20, for = 25 and = 35, for = 40 and 
N = 50), and also the values of the condition number cond of the system of 
linear algebraic equations (30). In this case the relative errors coincide with 
the absolute ones. The best possible error is Amin = 0.83 • 10~^^. A small 
neighborhood of the root of the polynomial AQ is eliminated as before. 

Table 2 



N 


15 


20 


25 


35 


40 


50 


cond 


().7() ■ 10' 


0.95 ■ lO'"" 


0.3G ■ 10-^" 


0.12 ■ 10-^- 


0.11 ■ 10^-- 


0.11 ■ 10^- 


A 


0.13- lO-'' 


0.81- IQ-^ 


0.13- 10-^ 


0.12-10-"' 


0.75 • 10-^^ 


0.73 - 10-^^ 


Ao 


0.7-10-'' 




0.7- 10-« 




0.2- 10-y 
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11 Small deformations of approximated func- 
tions and acceleration of convergence of 
series 

Let a function f{x) be expanded into the series in Chebyshev polynomials, 
i.e., suppose that /(x) = J2iZoCiTi; consider a partial sum 

N 

Mx)=J2c,Ti (37) 

i=o 

of this series. Using formula (35), it is easy to verify that the linear Pade- 
Chebyshev approximant of the form (1) or (25) to the function f{x) coincides 
with the linear Pade-Chebyshev approximant to polynomial (37) for = n+ 
2m, i.e., it depends only on the first n+2m+l terms of the Fourier-Chebyshev 
series of the function f{x); a similar result is valid for the approximant of 
the form (17) or (18) to even or odd functions, respectively. Note that for 
N = n + 2m the polynomial Jn is the result of application of the algorithm of 
linear (or nonlinear) Pade-Chebyshev approximation to f{x), the exponents 
m and n being replaced by and 2m + n. 

The interesting effect mentioned in [0 consists in the fact that the error of 
the polynomial approximant fn+2m depending on n + 2m + 1 parameters can 
exceed the error of the corresponding Pade-Chebyshev approximant of the 
form (1) which depends only on n + m + 1 parameters. For example, consider 
an approximant of the form (18) to the function tan jX on the segment 
[— 1, 1]. For m = n = 3 the linear Pade-Chebyshev approximant to tan |x 
has the error of order 10~^^, and the corresponding polynomial approximant 
of the form (37) has the error of order 10~^^. This polynomial of degree 19 
(odd functions are in question, and hence m = n = 3 in (18) corresponds 
to m = 6, = 7 in (1)) can be regarded as a result of a deformation of 
the approximated function tan jx. This deformation does not affect the first 
twenty terms in the expansion of this function in Chebyshev polynomials and, 
consequently, does not affect the coefficients in the corresponding rational 
Pade-Chebyshev approximant, but leads to an increase of several orders in 
its error. Thus, a small deformation of the approximated function can result 
in a sharp change in the order of error of a rational approximant. 

Moreover the effect just mentioned means that the algorithm extracts 
an additional information concerning the next components of the Fourier- 
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Chebyshev series from the polynomial (37). In other words, in this case 
the transition from the Fourier-Chebyshev series to the corresponding Pade- 
Chebyshev approximant accelerates convergence of the series. A similar effect 
of acceleration of convergence of power series by passing to the classical Pade 



approximant is known (see, e.g., [16 



It is easy to see that the nonlinear Pade-Chebyshev approximant of the 
form (1) to the function f{x) depends only on the first m + n + 1 terms of 
the Fourier-Chebyshev series for / (x) , so that for such approximants a more 
pronounced effect of the type indicated above takes place. 

Since one can change the "tail" of the Fourier-Chebyshev series in a quite 
arbitrary way without affecting the rational Pade-Chebyshev approximant, 
the effect of acceleration of convergence can take place only for the series with 
an especially regular behavior (and for the corresponding "well-behaved" 
functions). See |7[ for some details. 



12 Error autocorrection and Interval 
Analysis 

Undoubtedly one of the most actual problems in Interval Analysis in the 
sense of is to get realistic interval estimates for calculation errors. 



i.e. to get efficient estimates close to the virtual calculation errors. Difficul- 
ties arise where intermediate errors compensate each other. For the sake of 
simplicity let us suppose that we calculate values of a real smooth function 
z = F{yi, . . . , ?/7v) of real variables yi, . . . , y^, and suppose that all round- 
off errors are negligible with respect to input data errors. This situation is 
especially examined in the framework of Ju.V. Matijasevich's "a posteriori 



interval analysis", see, e.g., [jTO[- In this case the error AF of F{yi, . . . ^y^) 



can be evaluated by the formula 

AF = Y.— -Ay, + r, (38) 

i=l (JVi 

where r is negligible. The sum J2iLi{dF/dyi) ■ Ayi in (38) can be treated 
as a scalar product of the gradient vector {dF/dyi} and the vector of errors 
{Ay.}. 
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The effect of error autocorrection corresponds to the case, where the 
gradient {dF/dyi} is not small but the scalar product is small enough. In 
this case these vectors are almost orthogonal and the following approximate 
equation holds: 

gg.A..^O (39) 

This effect is typical for some ill-posed problems. 

For all the standard interval methods, the best possible estimation for 
AF is given by the formula 

|AF|<||g|.|A«|. (40) 

This estimate is good if the errors Ayi are "independent" but it is not re- 
alistic in the case discussed in this paper (calculation of values of rational 
approximants when the error autocorrection effect works). In this case 

ao + aix + a2X^ + ... + a„a;" 

where = m + n + 3, . . . , vn] = {x, Gq, . . . , an, bo,..., bm}. For the 
sake of simplicity let us suppose that Ax — 0. In this case we can use the 
equality (22) to transform the formula (38) into the formula 

So the estimation (39) transforms into the estimation 

It is easy to check that estimations of this type are not realistic. Consider the 
following example discussed in Introduction: f{x) = arctana; on the segment 
[— 1, 1], R{x) has the form (1) for m = 8, n = 9. In this case the estimation 
(41) is of order 10~^ but in fact AR is of order 10~^^. This situation is 
typical for examples examined in this paper. In fact we have an approximate 
equation 

n i m p(^.\^.j 
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where e is the absolute error of the used approximation method. Of course, 
this approximate equation holds if our approximation method is good and 
the uncertainty relation (discussed above in Section 2) is valid. Then ap- 
proximate equation (43) corresponds to the approximate equation (39). 

The error autocorrection effect appears not only in rational approximation 
but in many problems. Other examples (where this effect occurs in a weaker 
form) are the method of least squares and some popular methods for the 
numerical integration of ordinary and partial differential equations, see, e.g.. 

In principle the error autocorrection effect appears if input data form an 
(approximate) solution (or solutions) of an equation (or equations or sys- 
tems of equations). Then the corresponding errors could form an approxi- 
mate solution (or solutions) for another equation (or equations or systems of 
equations). As a result this could lead to corrections for standard interval 
estimates. 

Of course, in the theory we can include all the preliminary numerical 
problems to our concrete problem and to use, e.g., a posteriori interval anal- 
ysis for the "united" problem. However, in practice this is not convenient. 

In practice situations of this kind often appear if we use approximate 
solutions to ill conditioned systems of linear algebraic equations. If the con- 
dition number of the system is great and the residual of the solution (with 
respect to the system) is small, then our software must send us a "warning" . 
This means that an additional investigation for error estimates is needed. In 
the theory of interval analysis this corresponds to a further development of 
"a posteriori interval methods" in the spirit of pTj-pOl . 

Remark. We have discussed "smooth" computations. Note that for 
many "nonsmooth" optimization problems all the interval estimates could 
be good and absolutely exact. A situation of this kind (related to solving 
systems of linear algebraic equations over idempotent semirings) is described 
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